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Foreword 


The  Navy’s  mission  and  the  performance  of  its  weapons  systems  rely  heavily 
upon  knowledge  of  the  environment  in  which  they  must  operate.  The  amount 
of  data  available  to  describe  the  world’s  oceans  is  expanding,  due  primarily 
to  the  increase  of  remotely  sensed  information;  but  the  ocean  is  still  under¬ 
sampled.  Thus,  to  provide  an  accurate  depiction  of  the  three-dimensional  ocean 
thermal  structure,  we  are  challenged  to  make  the  best  use  of  available 
observations.  Satellite  measurements  of  the  ocean’s  surface  provide  us  with 
a  way  to  resolve  mesoscale  features,  such  as  ocean  fronts  and  eddies. 
Sophisticated  objective  analyses,  such  as  the  Optimum  Thermal  Interpolation 
System  (OTIS),  have  been  developed  and  implemented  at  the  Navy’s  Fleet 
Numerical  Oceanography  Center.  These  products  assure  us  that  such 
information  is  intelligently  combined  with  in  situ  data  from  ships,  buoys,  and 
bathythermographs.  Automated  quality  control  of  these  data  is  a  key  element 
in  producing  an  accurate  analysis  product.  This  report  focuses  on  those 
procedures,  and  describes  the  techniques  used  to  assure  that  erroneous  data 
are  not  negatively  influencing  .he  final  product.  Since  OTIS  results  and  other 
associated  model  outputs  are  regularly  disseminated  to  the  Fleet,  improve¬ 
ment  in  the  quality  control  of  the  environmental  data  provides  the  Fleet  with 
better  guidance  for  operational  decision-making. 


W.  B.  Moseley 
Technical  Director 


J.  B.  Tupaz,  Captain,  USN 
Commanding  'Officer 


Executive  Summary 


The  Fleet  Numerical  Oceanography  Center  (FNOC)  provides  daily  analyses 
of  the  three-dimensional  ocean  thermal  structure  both  to  the  Fleet  and  to 
regional  oceanography  centers  around  the  world.  These  analyses  are  performed 
on  both  hemispheric  and  regional  scale  grids,  with  resolutions  as  fine  as  20  km 
in  some  areas.  The  Remote  Sensing  Branch  of  the  Naval  Ocean  Research  and 
Development  Activity  (NORDA)  has  been  involved  in  assessing  the  impact 
of  multichannel  sea  surface  temperatures  (MCSSTs)  on  these  ocean  thermal 
analyses.  Specifically,  NORDA  has  worked  closely  with  FNOC  in  developing 
the  Optimum  Thermal  Interpolation  System  (OTIS).  NORDA’s  primary 
interest  was  to  assure  that  the  MCSSTs  were  properly  utilized  to  detect  and 
analyze  mesoscale  ocean  fronts  and  eddies,  with  particular  attention  paid  to 
how  the  MCSSTs  were  assimilated  with  other  types  of  data.  Through  this  joint 
effort,  FNOC  has  successfully  implemented  OTIS  as  the  operational  ocean 
thermal  analysis  system  for  the  global  analysis  and  the  Gulf  Stream  regional 
analysis.^ 

In  addition  to  processing  and  assimilating  data  from  various  sources,  OTIS 
includes^ algorithms  to  automatically  make  decisions  about  the  quality  of  the 
observations  and  to  ignore  data  that  are  apparently  erroneous<fThere  are  two 
basic  methods  of  quality  controlling  data  in  OTIS.  The  first  is  the  gross-error 
check,  where  observations  are  compared  to  the  climatological  first -guess  field 
to  assure  that  the  data  fall  within  reasonable  ranges  of  the  expected  values. 
Then,  groups  of  observations  are  subjected  to  a  check  for  horizontal 
consistency,  often  called  a  “buddy  check.”  Thus,  if  a  particular  observation 
cannot  be  corroborated  by  other  nearby  data,  it  is  generally  excluded  from 
the  analysis.  This  report  describes  the  details  of  the  automated  quality  control 
procedures  in  OTIS,  and  provides  an  account  of  the  fine  tuning  that  is  necessary 
to  optimize  these  techniques.  The  end  result  is  a  system  that  eliminates  most  of 
the  bad  data  while  retaining  most  of  the  valid  observations,  thus  contributing 
to  an  improved  ocean  thermal  analysis  product. 
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Quality  Control  Algorithms  for  Ocean  Temperature  Data 


I.  Introduction 

Over  the  last  two  decades,  we  have  seen  dramatic 
improvements  in  our  ability  to  describe  the  environ¬ 
ment  in  which  we  live.  With  the  advent  of  remotely 
sensed  data,  in  particular,  the  world’s  air-ocean  data 
base  has  continued  to  expand.  As  a  result,  we  now 
require  some  of  the  most  powerful  computers  in  the 
world  to  process  and  interpret  the  vast  amounts  of 
available  environmental  data.  Nevertheless,  large 
regions  of  the  globe  remain  undersampled.  Not  only 
are  environmental  data  irregularly  distributed  in  space 
and  time,  but  they  come  from  a  variety  of  sensors,  each 
with  different  error  characteristics.  Thus,  increasingly 
sophisticated  algorithms  have  been  developed  to 
provide  objective  analysis  systems  that  can  intelligently 
assimilate  the  available  data.  Automated  error 
detection,  while  often  overlooked,  must  be  an  inherent 
part  of  any  such  system;  it  is  a  key  element  in  producing 
accurate  and  physically  realistic  analyses. 

The  most  common  analysis  technique  used  today  is 
the  statistical  method  known  as  optimum  interpolation. 
It  was  first  applied  to  the  multivariate  analysis  of  envi¬ 
ronmental  variables  by  Gandin  (1%3).  Over  the  years, 
it  has  been  adapted  for  use  in  operational 
meteorological  analyses  by  the  National  Meteorological 
Center  (McPherson  et  al.,  1979),  the  Air  Force  Global 
Weather  Center,  the  Canadian  Recherche  en  Prevision 
Numerique  (Rutherford,  1976),  the  European  Center 
for  Medium  Range  Weather  Forecasts  (Lorenc,  1981), 
the  United  Kingdom  Meteorological  Office  (Lorenc, 
1986),  the  Navy’s  Fleet  Numerical  Oceanography 
Center  (Barker  et  al.,  1988),  and  others.  While 
optimum  interpolation  has  also  been  utilized  for 
oceanographic  experiments  (Bretherton  et  al.,  1976; 
Freeland  and  Gould,  1976;  White,  1977;  Roemmich, 
1983;  Robinson  and  Leslie,  198S),  its  use  has  not  been 
widespread  for  this  particular  type  of  application. 
However,  the  Navy  has  recently  implemented  the  first 
operational  three-dimensional  ocean  thermal  analysis 
that  uses  the  optimum  interpolation  methodology,  lliat 
software,  the  Optimum  Thermal  Interpolation 
System  (OTIS),  replaced  the  previous  analysis  system, 
the  Expanded  Ocean  Thermal  Structure  (EOTS) 
analysis  (Clancy  and  Poliak,  1983),  as  the  Navy’s 
operational  product  at  the  Fleet  Numerical 
Oceanography  Center  (FNOC)  in  Monterey, 
California. 


The  initial  implementation  of  OTIS  was  for 
hemispheric-scale  (200-  to  400-km  resolution)  analyses 
only,  and  is  referred  to  as  OTIS  1.0.  The  Naval  Ocean 
Research  and  Development  Activity  (NORDA)  assisted 
FNOC  in  the  development  of  a  regional-scale  version 
of  OTIS  1 .0  that  can  be  run  in  various  areas  on  a  20-  to 
40-km  resolution  grid.  The  regional  analysis  uses  a 
feature  model  approach,  where  front  and  eddy 
positions  obtained  from  satellite  infrared  tmd  altimetry 
data  are  used  to  embed  physically  realistic  fronts  and 
eddies  into  the  three-dimensional  temperature  fields 
(Bennett  et  al.,  1989). 

Additionally,  NORDA  developed  another  regional 
version  of  OTIS  1 .0  that  is  capable  of  analyzing  only 
sea  surface  temperature  (SST)  at  even  higher 
resolutions.  This  system,  called  SST-OTIS,  can  fully 
utilize  the  abundant  multichannel  sea  surface 
temperature  (MCSST)  data  from  the  polar-orbiting 
satellites.  Because  of  the  large  ar  ounts  of  data  that 
must  be  processed  and  the  nur  .ler  of  grid  points 
that  must  be  analyzed,  the  SST-OTIS  was  designed  to 
run  on  FNOC’s  supercomputer — the  Control  Data 
Corporation’s  Cyber  205.  The  SST-OTIS  contains  all 
the  features  of  the  regional  OTIS  1.0  plus  some 
additional  capabilities.  Physically,  OTIS  1.0  does  not 
need  high-resolution  (up  to  4  km)  data  to  resolve 
features  on  the  hemispheric  scale.  Also,  from  a 
practical  standpoint,  the  computer  resources  available 
to  OTIS  1.0  are  limited.  Therefore,  OTIS  1.0  averages 
the  MCSST  data  to  form  an  MCSST  “superob”  at 
each  grid  point  prior  to  performing  the  data  analysis. 
This  procedure  is  neither  necessary  nor  desirable  in  the 
high-resolution  SST-OTIS.  To  analyze  mesoscale 
features,  such  as  fronts  and  eddies,  we  wanted  to 
consider  the  input  of  each  available  observation. 

While  SST-OTIS  is  not  a  separate  operational 
product,  the  ideas  presented  here  on  data  quality 
control  apply  to  other  analysis  systems,  as  well,  and 
many  of  the  suggested  changes  in  quality  control  have 
been  directly  incorporated  in  OTIS  1.0.  SST-OTIS  can 
be  executed  in  either  hemispheric  or  regional  mode, 
with  the  option  to  superob  MCSST  data  included,  so 
the  SST-OTIS  was  used  for  all  the  experiments 
described  in  this  paper.  Hereafter,  the  generic  OTIS 
is  frequently  referred  to,  unless  a  distinction  needs  to 
be  made  between  the  various  versions  of  the  software. 
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The  evaluation  of  a  data  analysis  scheme  can  take 
several  forms.  One  method  is  to  perform  an  objective 
statistical  evaluation  of  the  results.  This  validation  is 
generally  accomplished  by  comparing  the  analysis 
results  at  a  particular  point  to  recently  obtained  data 
that  were  not  included  in  the  previous  assimilation 
(Clancy  et  al.,  1990).  Given  many  such  comparisons, 
statistics  can  be  generated  to  describe  the  accuracy  of 
the  analysis  scheme.  But  if  our  goal  is  to  somehow 
replicate  the  decisions  that  a  human  analyst  would 
make  given  the  same  information,  we  should  also 
subjectively  evaluate  how'  well  the  individual  algorithms 
are  meeting  this  goal.  For  example,  the  human  analyst 
would  look  at  several  things — the  data  available  near 
the  grid  point,  the  observations  that  were  rejected  as 
erroneous,  the  observations  that  were  actually  included 
in  the  analysis,  and  the  observations  having  the  most 
influence  on  the  outcome. 

The  SST-OTIS  was  developed  primarily  to  assure 
that  the  MCSST  data  were  receiving  the  appropriate 
weight  relative  to  the  other  data  types,  and  that  their 
impact  on  the  analysis  was  a  positive  one.  However, 
when  the  OTIS  data-handling  algorithms  were 
scrutinized,  many  shortcomings  were  identified  in  the 
data  selection  and  quality  control  procedures — 
shortcomings  that  detrimentally  affected  all  data 
sources.  The  end  result  was  that  many  good 
observations  were  actually  being  ignored  by  the 
analysis,  and  the  data  selected  were  often  not  the  most 
appropriate. 

Quality  control  of  the  available  data  is  a  crucial  step 
in  any  analysis  procedure.  The  choice  to  include  or 
exclude  even  one  piece  of  information  can  result  in 
significant  changes  to  an  analysis  (Thiebaux,  1980; 
Phoebus,  1983;  Hollingsworth  et  al.,  1985),  especially 
if  that  observation  is  in  a  data-sparse  region.  Since 
much  of  the  world’s  oceans  are  sparsely  sampled, 
particularly  at  the  subsurface,  it  is  crucial  that  data 
not  be  discarded  unnecessarily.  While  no  objective 
quality  control  system  is  perfect,  we  strive  for  a  system 
that  will  eliminate  most  of  the  bad  observations  without 
rejecting  too  many  of  the  useful  ones. 

This  report  emphasizes  the  automated  quality  control 
procedures  used  in  OTIS.  A  brief  background  of 
optimum  interpolation  is  presented  in  Section  II. 
Section  III  describes  the  original  techniques  used  to 
objectively  quality  control  the  data  in  OTIS;  Section  IV 
discusses  some  of  the  problems  with  these  methods. 
Section  V  shows  experimental  results  that  illustrate  how 
changes  in  the  quality  control  algorithms  greatly 
decrease  the  incidence  of  data  rejection.  Section  VI 
suggests  areas  where  further  improvements  in  quality 
control  can  still  be  made.  The  problems  with  the  data 
selection  algorithms  have  been  discussed  in  a  separate 
report  (Phoebus,  1988). 


11.  Background  Theory 

The  application  of  optimum  interpolation  to  data 
analysis  is  described  in  detail  by  Bergman  (1979)  and 
Lorenc  (1981).  The  particular  equations  and  notations 
used  in  OTIS  are  given  by  Clancy  et  al.  (1989).  In 
optimum  interpolation,  the  analyzed  variable  is 
obtained  from  a  linear  combination  of  the  available 
data,  with  weights  assigned  to  each  observation  in  such 
a  way  as  to  minimize  the  analysis  error  in  a  least-squares 
sense.  In  OTIS,  the  observations  are  converted  to 
anomalies  ‘’rom  the  first-guess  field,  so  that  the 
analyzed  temperature  is  actually  computed  as  a 
correction  to  the  first-guess  field  (usually  climatology). 
Thus,  given  a  group  of  S'  observations,  the  analyzed 
temperature  at  grid  point  k  is  given  by 

7-;  =  7-;  +  I  a,,(r;  -  r;) ,  d) 

1  =  I 

where  is  the  first-guess  temperature  at  the  grid 
point,  Tj  is  the  first  guess  interpolated  to  the  location 
of  the  /th  observation,  T°  is  the  observed  temper¬ 
ature  of  the  /th  observation,  and  the  weight  assigned 
to  the  /th  observation  is  given  by  o,^. 

The  set  of  weights  is  chosen  to  minimize  the  analysis 
error,  and  is  obtained  by  solving  the  set  of  linear 
equations 

s 

n,*  =^2(»7y  + 

for  /=  1,2 . yV,  (2) 

where  rj,*  is  the  correlation  between  the  observation 
and  the  analyzed  temperature  at  the  grid  point,  the 
rjjy  are  the  autocorrelations  between  observation  / 
and  every  other  observation  j,  is  the  noise-to-signal 
ratio  for  observation  /,  and  is  the  Kronecker  Delta 
function,  defined  as 

6,j  =  1,  for  /  =  7, 

d,y  =  0,  for/#y.  (3) 

The  correlation  function  used  in  OTIS  is  the 
Gaussian  function 


(4) 


where  Ax„,  are  the  east-west  and  north-south 
distances  oetween  the  two  locations,  Aq  is  the  time 
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difference  between  the  two  observations,  and  AXi^, 
and  Cr^  are  the  E-W,  N-S,  and  time  correlation 
scales  appropriate  to  the  region  of  interest.  The 
correlation  can  be  evaluated  using  the  same 
equation,  where  location  j  becomes  the  location  of  grid 
point  k,  and  is  the  age  of  the  observation. 
Figure  1  illustrates  how  the  correlation  changes  with 
distance  from  the  grid  point,  assuming  =  0  and 
is  twice  as  large  as  .  Figure  2  shows  how  the 
correlation  decreases  as  the  observations  age,  for 
various  values  of  CT^,.  The  total  correlation  can  be 
thought  of  as  the  product  of  these  two  separate 
functions. 

The  set  of  N  observations  influencing  the  analysis 
at  a  particular  point  are  those  observations  that  are  the 
most  highly  correlated  with  the  analyzed  value  at 
the  grid  point.  The  details  of  the  data  selection 
algorithms  are  given  by  Phoebus  (1988).  Ba."’cally,  the 


LONGITUDE 

Figure  I .  Spatial  correlation  function  for  AX,;  =  200  km  and 
BY,;  =  100  km.  Contours  are  plotted  from  0. 1  to  0.9  at  inter¬ 
vals  of  0.1.  The  grid  point  is  located  at  the  center  of  the  figure. 
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Figure  2.  Time  correlation  function  for  various  values  of  CT,,. 
given  in  hours. 


total  correlation  rj,*.  is  evaluated  for  each  observation 
within  a  certain  distance  of  the  grid  point— a  distance 
that  is  also  a  function  of  AX^  and  BY^.  The  15  most 
highly  correlated  observations  are  retained  for  input 
into  the  analysis.  If  fewer  than  15  are  available,  then 
the  entire  set  is  used. 

To  assure  that  the  selected  observations  contain  valid 
information,  some  means  of  quality  controlling  the 
data  must  be  provided.  Before  the  days  of 
computerized  analyses,  the  human  analyst  would 
survey  the  data  and,  based  on  his  or  her  e.xperience 
and  knowledge  of  the  physical  variables  being 
analyzed,  would  decide  to  reject  or  ignore  certain 
information.  This  decision  was  usually  made  by 
comparing  an  observation  to  other  nearby  data  or  to 
values  considered  “reasonable”  for  that  particular 
parameter.  Because  of  the  large  volume  of  global 
environmental  data  being  processed  today,  it  has 
become  necessary  to  automate  almost  all  of  the  data 
quality  control  procedures. 

At  FNOC  and  other  operational  centers,  most  of  the 
quality  control  is  left  to  the  individual  user.  That  is, 
the  data  receive  very  little  checking  before  being  placed 
in  the  data  archive  files.  The  argument  for  this 
approach  is  that  the  validity  of  a  certain  piece  of  data 
is  somewhat  dependent  upon  the  particular  application. 
For  example,  an  expendable  bathythermograph  (XBT) 
deployed  in  an  oceanographic  eddy  provides  very  useful 
information  for  a  mesoscale  analysis.  However,  for 
a  hemispheric-scale  analysis,  such  an  observation 
represents  a  feature  that  cannot  be  resolved  and  is 
essentially  noise.  For  the  latter  product,  the  observation 
should  be  rejected.  The  observation  is  not  erroneous, 
but  neither  is  it  applicable  to  the  particular  problem. 
Therefore,  each  operational  product  must  have  its  own 
rather  intensive  quality  control  procedures. 

III.  Original  Quality  Control 
Algorithms  in  OTIS 

The  quality  control  procedures  in  OTIS  are 
composed  of  three  separate  steps.  First,  observations 
with  physically  unrealistic  values  are  ignored.  Next, 
each  observation  is  subjected  to  a  “gross-error  check,” 
where  it  is  compared  to  climatology  (the  first-guess 
field).  Finally,  each  observation  is  compared  to  other 
nearby  observations  in  a  procedure  known  as  a 
horizontal  consistency  check,  or  “buddy  check.”  These 
procedures  are  not  unique  to  OTIS.  They  have  been 
used  successfully  in  the  meteorology  community  for 
many  years  (Daly  et  al.,  1985). 

Observations  that  are  outside  the  range  of  normal 
ocean  temperatures  are  rejected  as  the  data  files  are 
initially  read  into  OTIS.  Thus,  reports  of  less  than  -2°C 
or  greater  than  40®C  are  screened  from  the  analysis. 
Such  values  often  occur  due  to  transmission  or 
recording  errors. 
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The  gross-error  check  is  performed  at  the  time  the 
anomalies  are  formed.  If  any  obser\  ation  deviates  from 
climatology  by  more  than  a  fixed  amount,  then  it  is 
e.xcluded  from  the  data  set.  Presently  in  OTIS,  this 
tolerance  is  constant  everywhere  on  the  grid.  Data 
anomalies  that  exceed  the  predefined  tolerance  are 
eliminated  and  never  used  in  the  analysis. 

The  buddy  check  is  more  an  integral  part  of  the 
analysis,  because  it  is  performed  at  each  point  only 
after  the  (up  to)  15  most  highly  correlated  observed 
anomalies  have  been  selected.  Based  upon  the  work 
of  Bergman  (1979),  the  buddy  check  compares  the 
temperature  difference  between  two  anomalies  to  some 
tolerance  that  is  a  function  of  the  autocorrelation  of 
the  two  observations,  in  mathematical  terms,  the 
relationship  that  must  be  satisfied  is 

!  (7-f  -  Tf)  -  (T;  -  7; )  i  <  (0  -  br),j)  ,  (5) 

where  a  and  b  are  empirical  constants,  is  the 
autocorrelation  computed  from  equation  (4),  and  o* 
is  the  sample  standard  deviation  from  the  previous 
analysis.  If  the  absolute  temperature  difference  between 
the  anomalies  T°  -  and  T°  -  Tf  is  greater  than  the 
expression  on  the  right-hand  side  of  equation  (5),  then 
a  toss  flag  is  set  against  each  of  the  two  observations 
to  indicate  that  they  are  not  in  agreement.  The  value 
of  this  toss  flag  is  1.0. 

After  each  possible  pair  of  observations  at  the  grid 
point  has  been  compared  in  this  way,  the  total  number 
of  toss  flags  set  against  each  observation  is  checked. 
Any  observation  with  less  than  2.0  toss  flags  is 
automatically  saved.  Otherwise,  the  observed  anomaly 
with  the  greatest  number  of  toss  flags  is  removed  from 
the  set  of  data  selected  for  this  grid  point;  it  is  not 
removed  from  the  data  set  as  a  whole.  Subsequently, 
any  flags  that  were  set  on  other  observations  by  the 
rejected  observation  are  also  removed.  Each  remain¬ 
ing  pair  of  observations  is  then  compared  again  using 
equation  (5),  and  the  next  observation  receiving  the 
most  toss  flags  is  rejected. 

This  iterative  process  continues  until  no  observation 
has  a  total  of  2.0  or  more  toss  flags,  or  until  only  two 
observations  remain.  Because  only  observed  anomalies 
with  2.0  or  more  toss  flags  can  be  rejected,  at  least 
two  other  observations  must  disagree  with  the 
questionable  report  before  it  can  be  rejected.  Thus, 
one  bad  report  cannot  cause  good  data  to  be 
eliminated. 

The  buddy  check  is  described  schematically  in 
Figure  3.  The  abscissa  is  the  absolute  temperature 
difference  between  two  observed  anomalies.  The 
ordinate  is  the  autocorrelation  between  the  same  two 
data  points.  The  plotted  line  represents  the  dividing 
line  between  a  “toss”  or  “no  toss”  situation.  If  the 
two  observations  in  question  have  a  temperature 
difference  that  is  greater  than  the  tolerance  for  that 
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Figure  3.  Functional  illustration  of  the  division  between  setting 
or  not  setting  toss  flags  on  a  pair  of  observations  being 
considered  by  the  buddy  check. 

particular  autocorrelation  (in  other  words,  to  the  right 
of  the  line),  then  toss  flags  are  set  on  both  anomalies. 
The  diagram  also  makes  it  easy  to  see  that  as  the  corre¬ 
lation  between  the  observations  increases,  the  allowed 
temperature  difference  between  them  decreases.  Thus, 
in  general,  data  that  are  closer  together  in  space  and 
time  are  expected  to  agree  in  value  more  than 
observations  that  are  farther  apart. 

The  particular  values  chosen  for  o,  b,  and  affect 
the  slope  and  intercept  of  the  dividing  line.  Since  o* 
represents  the  mean  departure  of  the  observations  from 
climatology  in  the  previous  analysis,  a  larger  value  of 
oj  reflects  the  fact  that  a  higher  variance  is  expected 
in  the  data  anomalies.  For  example,  an  increase  in  a{ 
from  0.30  to  0.80  moves  the  entire  dividing  line  to  the 
right,  thus  increasing  the  overall  tolerance  for 
temperature  deviations  between  neighboring 
observations  (Fig.  4),  with  more  of  an  increase  evident 
for  the  less  correlated  data.  Similarly,  adjusting  the 
values  of  a  and  b  from  2.0  and  1.0  to  3.0  and  1.5, 
respectively,  while  holding  oj  constant,  also  results  in 
fewer  toss  flags  being  accessed  (Fig.  5).  Since  a  and 
b  are  empirical  constants,  they  can  be  thought  of  as 
tuning  parameters  whose  values  can  be  adjusted  to 
further  restria  or  loosen  the  tolerance  on  flagging  data. 

IV.  Discussion  of  Quality 
Control  Problems 

The  specific  quality  control  algorithms  that  were 
initially  utilized  in  OTIS  have  been  described.  During 
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Figure  4.  Illustration  of  how  a  larger  value  of  Oy  in  Equa¬ 
tion  (5)  increases  the  temperature  difference  allowed  between 
two  observations  before  toss  flags  are  set  by  the  buddy  check. 
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Figure  5.  Illustration  of  how  larger  values  of  a  and  b  in  Equa¬ 
tion  (5)  increase  the  temperature  difference  allowed  between  two 
observations  before  toss  flags  are  set  by  the  buddy  check. 

the  development  of  the  SST-OTIS  at  NORDA,  it 
became  apparent  that  large  amounts  of  data  were  being 
rejected,  and  the  resulting  analysis  closely  resembled 
climatology.  Further  investigation  showed  similar 
problems  in  the  global  three-dimensional  OTIS  1 .0, 
as  well.  Therefore,  an  extensive  study  of  the  quality 


control  algorithms  was  undertaken,  and  several 
modifications  were  made  as  a  result. 

First,  the  gross-error  check  was  rejecting  all 
temperature  anomalies  greater  than  5^C,  which  proved 
excessive.  The  purpose  of  the  gross-error  check  should 
be  to  reject  observations  that  are  obviously  erroneous, 
that  is,  those  observations  outside  the  range  of 
reasonable  values  for  a  specific  location  at  a  given  time 
of  the  year.  Since  mesoscale  events  are  sampled,  even 
though  they  may  not  bt  analyzed,  deviations  of  5' 
from  climatology  would  not  be  at  all  unusual  in  the 
vicinity  of  fronts  and  eddies.  Therefore,  it  is  premature 
to  reject  such  observations  in  the  gross-error  check. 
It  would  be  preferable  to  leave  them  in  and  allow  them 
to  be  interrogated  by  the  buddy  check.  At  NORDA’s 
suggestion,  FNOC  agreed  to  increase  the  tolerance 
from  5°  to  7°C  for  the  hemispheric  analysis. 

A  recent  occurrence  of  very  cold  water  in  the  eastern 
equatorial  Pacific  made  even  the  7°C  tolerance  seem 
too  restrictive  for  some  events.  For  example,  MCSST 
data  from  May  and  June  1988  in  the  region  from  100' 
to  160°W  indicated  anomalies  that  approached  the 
limits  of  the  gross-error  checks.  Figures  6a  and  6b 
compare  the  first-guess  SSTs  to  the  values  of  the 
MCSST  superobs  at  the  same  locations  for  May  9, 
1988.  Differences  of  more  than  6°C  can  be  seen  near 
0.5°N  and  134. 0°W.  The  strengths  of  these  anomalies 
were  verified  by  other  independent  sources  of 
information.  This  extremely  cold  upwelling  event, 
coupled  with  NORDA’s  observation  of  gaps  in  the 
MCSST  data  along  the  equator,  resulted  in  changes 
in  the  methods  used  to  quality  control  MCSSTs  at  the 
National  Environmental  Satellite  Data  and 
Information  Service  (NESDIS).  NESDIS  increased 
their  gross-error  check  tolerance  from  7°  to  10°C  to 
assure  that  they  were  not  disregarding  valid  MCSSTs 
in  this  area.  NORDA  recommended  that  FNOC 
consider  similar  changes  in  the  hemispheric  OTIS  gross- 
error  check,  at  least  in  certain  regions. 

For  regional  analyses  such  as  the  SST-OTIS,  a  case 
can  be  made  for  allowing  larger  anomalies  to  pass 
the  gross-error  check.  For  example,  a  slight  shift  in  the 
position  of  an  eddy  or  the  north  wall  of  the  Gulf 
Stream  can  result  in  extremely  large,  but  nevertheless 
valid,  anomalies.  In  SST-OTIS,  the  gross-error 
tolerance  was  set  initially  at  7®C,  but  has  been  increased 
even  more,  based  on  data  from  the  30  March  1988 
analysis.  Figure  7  indicates  the  position  of  the  north 
wall  in  the  flrst-guess  field  on  that  day.  A  large  number 
of  MCSSTs  are  available  in  the  outlined  area  off  Cape 
Hatteras  (Figs.  8  and  9).  The  15®C  isotherm,  which 
is  often  indicative  of  the  surface  position  of  the  north 
wall,  is  sketched  from  this  data.  Notice  the  two 
meanders  in  this  isotherm.  Judging  from  the  MCSST 
data,  the  north  wall  in  the  first-guess  field  was  displaced 
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Figure  6.  (a}  Climatological  first-guess  SSTs  for  May  9,  1988,  at  grid  points  in  the  eastern  equatorial  Pacific,  lb)  MCSST  superob 
temperatures  for  May  9,  1988,  at  grid  points  in  the  eastern  equatorial  Pacific. 


Figure  7.  Climatological  first-guess  SST  field  for  March  30,  1988,  with  the  Gulf 
Stream  front  and  eddies  embedded. 
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Figure  8.  XfCSST  observations  for  March  30,  1988,  just  off  the 
coast  of  Cape  Hatteras.  The  15  hand-analyzed  isotherm  is 
shown. 


LONGITUDE 


Figure  9.  Hand-drawn  analysis  of  the  MCSST  data  shown  in 
Figure  8.  Sote  the  position  of  the  Gulf  Stream  as  indicated  by 
the  large  gradient  in  the  MCSST  data. 

too  far  to  the  southeast.  Although  the  climatology  in 
the  area  just  northwest  of  the  first-guess  position  of  the 
Gulf  Stream  was  approximately  14°C,  the  data 
indicated  that  the  true  temperature  in  the  region  was 
more  like  22°  or  23°C.  However,  the  gross-error  check 
rejected  these  observations  because  their  anomalies 
were  too  large. 

Figure  10a  provides  a  closer  look  at  the  position  of 
the  north  wall  of  the  Gulf  Stream  in  the  first-guess  SST 
field  just  off  Cape  Hatteras.  The  15°C  isotherm  is 
highlighted.  Two  separate  analyses  were  run;  both  used 


Figure  10.  Position  of  the  Gulf  Stream  front  just  off  Cape 
Hatteras  on  March  30,  1988.  Contours  are  every  I  'C. 
(a)  Climatological  first-guess,  (b)  SST  analysis  with  gross-error 
tolerance  of  7°C.  (c)  SST  analysis  with  gross-error  tolerance 
of  /0°C. 
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Figure  II.  Shaded  areas  represent  grid  points  where  the  buddy  check  was 
rejecting  at  least  one-third  of  the  selected  observations. 


the  same  buddy  check  algorithms.  The  only  difference 
was  the  value  assigned  to  the  gross-error  tolerance.  In 
the  original  analysis,  many  of  the  8®  and  9°C  anomalies 
were  eliminated  by  the  gross  error  check,  resulting 
the  analyzed  front  shown  in  Figure  10b.  When  the  gr  ,s 
error  tolerance  was  increased  from  7°  to  I0°C,  most 
of  these  MCSST  observations  were  retained.  Further¬ 
more,  the  buddy  chi  k  did  not  reject  them,  since  each 
group  had  numerous  supporting  observations.  The 
resulting  analysis  repositioned  the  front  more 
effectively  (Fig.  Kk),  better  reflecting  the  true  position 
of  the  north  wall  that  is  readily  seen  in  the  raw  MCSST 
data  (Fig.  9). 

Second,  the  original  buddy  check,  as  described,  was 
also  rejecting  far  too  much  data.  In  the  hemispheric 
analysis,  it  was  not  uncommon  for  more  than  30<7o  of 
the  selected  observations  to  be  rejected.  In  other  words, 
1 5  observations  would  be  selected  for  the  analysis  at 
a  particular  grid  point,  but  of  those  15,  five  or  more 
would  be  rejected.  Figure  11  illustrates  just  how 
widespread  the  problem  was.  The  shaded  areas  are  the 
grid  regions  where  at  least  one-third  of  the  data  points 
were  rejected  for  the  case  of  August  3, 1987.  There  were 
obviously  not  that  many  bad  observations,  so  the  fault 
was  clearly  with  the  buddy  check  algorithms. 

The  National  Meteorological  Center  (NMC)  had 
similar  problems  when  they  first  implemented 
Bergman’s  optimum  interpolation  analysis  scheme 


and  buddy  check  in  the  late  1970s.  Since  that  time,  they 
have  made  many  modifications  to  the  original 
algorithms  (Kistler  and  Parrish,  1982;  Phoebus,  1983; 
Dey  and  Morone,  1985;  DiMego  et  al.,  1985).  The 
result  is  a  buddy  check  with  more  nuances  and  details 
than  the  original,  but  one  that  rejects  fewer  good 
observations.  Many  of  these  ideas  were  easily 
incorporated  into  OTIS  for  testing  and  evaluation. 

For  example,  rather  than  set  only  loss  flags  when 
two  observations  disagree,  keep  flags  can  also  be  set 
for  a  pair  of  observations  that  corroborate  one  another 
(Kistler  and  Parrish,  1982).  Schematically,  this  would 
be  represented  by  the  area  left  of  the  plotted  line  in 
Figure  3.  Once  all  data  pairs  are  compared  and  all  flags 
set,  the  iterative  procedure  that  rejects  data  is  designed 
to  always  keep  any  anomaly  that  has  at  least  2.0  keep 
flags,  regardless  of  the  number  of  toss  flags  it  received. 
In  this  way,  any  observation  that  disagrees  with  two 
or  more  other  observations  can  only  be  tossed  if  there 
are  not  at  least  two  observations  that  support  it.  Such 
a  system  obviously  rejects  fewer  observations,  but  fails 
to  achieve  the  desired  result  in  one  situation.  If  two 
groups  of  observations  within  the  data  search  area  are 
not  in  agreement  (one  group  of  data  is  erroneous),  but 
each  group  contains  at  least  three  observation^  that 
corroborate  one  another,  no  data  will  be  rejected.  Such 
a  situation  could  occur,  for  example,  given  co-located 
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day  and  night  swaths  of  satellite  data,  or  given  a  swath 
of  satellite  data  in  the  vicinity  of  a  frequently  reporting 
buoy  or  ship.  ' 

To  prevent  the  scenario  described  above,  the  flagging 
procedure  can  be  further  modified.  Thus,  when  two 
observations  disagree,  rather  than  set  toss  flags  on  both 
of  them,  other  information  can  be  used  to  determine 
which  of  the  two  is  more  likely  in  error.  The  typical 
instrument  error  for  each  type  of  observation  is 
available  as  normal  input  to  the  optimum  interpolation 
scheme.  These  errors  can  be  used  to  assign  a  flagging 
hierarchy  to  the  various  data  types  (Phoebus,  1983). 
Then,  when  two  observations  disagree,  only  the  lower 
quality  observation  is  flagged.  If  the  two  observations 
are  of  the  same  type,  then  the  one  that  is  less  correlated 
with  the  grid  point  value  is  flagged.  The  relative  quality 
assigned  to  each  data  type  is  given  in  Table  1.  Keep 
flags  are  still  set  on  both  observations  if  they 
corroborate  one  another. 

A  further  refinement  has  been  made  to  the  flagging 
procedure  at  NMC  (DiMego,  pets.  comm.).  Rather 
than  use  a  value  of  1 .0  for  each  toss  and  keep  flag, 
the  autocorrelation  of  the  two  points  being  compared 
is  used.  This  value  would  be  equal  to  1.0  for  two 
observations  that  are  co-located  and  taken  at  the  same 
time.  Normally,  the  flag  value  would  be  less  than  1.0. 
This  use  of  the  autocorrelation  is  very  appealing,  for 
it  essentially  gives  greater  weight  to  flags  set  by  obser¬ 
vations  that  are  closer  in  space  and  time  to  the 
observation  being  checked.  Because  it  would  normally 
take  more  than  two  observations  to  accumulate  a  tot£d 
of  2.0  flags,  the  limits  placed  on  the  number  of  toss 
and  keep  flags  should  probably  be  reduced.  For 
example,  retain  all  observations  that  received  at  least 
1.5  keep  flags  and  reject  observations  that  received 


more  than  1.5  toss  flags  and  fewer  than  1.5  keep  Hags. 
These  numbers  may  be  altered  to  find  the  particular 
values  that  work  best  for  each  application. 

V.  Experimental  Results 

The  ideas  suggested  were  applied  to  the  OTIS  buddy 
check  in  an  attempt  to  retain  more  data  in  the  analysis. 
The  results  of  five  experiments  made  with  the 
hemispheric  SST-OTIS  are  presented  in  the  form  of 
histograms  in  Figures  12  and  13.  The  first  set 
of  histograms,  shown  in  Figure  12a-12e,  portray  how 
many  of  the  (up  to)  15  selected  observations  are 
rejected,  and  at  how  many  grid  points  each  situation 
occurs.  The  hemispheric  OTIS  grid  contains  3969  grid 
points,  2754  of  which  are  over  water.  Thus,  w  hen  OTIS 
used  the  original  buddy  check  to  quality  control  the 
data  for  August  3,  1987,  308  grid  points  tossed  5  of 
the  original  15  data  points,  while  277  grid  points 
rejected  6  of  the  selected  observations,  and  so  on 
(Fig.  12a).  All  totaled,  there  were  1417  grid  points  that 
eliminated  5  or  more  observations.  Thus,  51'^o  of  the 
analysis  points  rejected  at  least  33%  of  the  data  that 
normally  would  have  been  included  in  the  analysis.  It 
is  especially  disturbing  that  a  significant  number  of  grid 
points  ignored  more  data  than  they  used. 

To  add  another  perspective  to  the  extent  of  the 
problem,  for  this  particular  SST  analysis  there  were 
374  XBTs,  5261  ship/buoy  reports,  and  1862  MCSST 
superobs.  Thus,  less  than  7500  total  observations  were 
available  to  describe  the  surface  temperature  of  the 
world’s  oceans.  Yet,  th"  original  buddy  check  rejected 
3951  of  these  observations  (Table  2)  at  least  once.  This 
is  more  than  half  of  the  data. 


Table  1.  Instrument  error  assigned  to  each  data  type. 


RELATIVE 

WEIGHT 

DATA  TYPE 

HEMISPHERIC 

SST-OTIS 

REGIONAL 

SST-OTIS 

HEMISPHERIC 
OTIS  1.0 

1 

XBT 

0.2’C 

0.2'C 

0.2’C 

2 

MCSST 

0.7*C 

0.7°C 

0.7"C 

3 

DRIFTING  BUOY 

1.0*C 

I.O’C 

2.3’C' 

4 

FIXED  BUOY 

1.0°  C 

I.O’C 

2,3’C 

5 

COASTAL  MARINE 

I.O'C 

I.O’C 

2.3’C 

6 

SHIP 

2.3°C 

2.3’C 

2.3X 

’OTIS  1.0  does  not  distinguish  between  ship  and  buoy  reports. 


Table  2.  Total  number  of  obsenrations  tossed 
by  the  buddy  check. 


HEMISPHERIC 

SST-OTIS 

REGIONAL 

SST-OTIS 

CASE  1 

3951 

2544 

CASE  2 

2996 

1352 

CASE  3 

634 

223 

CASE  4 

562 

209 

CASE  5 

773 

193 

rti 
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Figure  12.  Histograms  illustrating  how  many  of  the  15  selected  observations  were  rejected  by  the  buddy 
check,  and  at  how  many  grid  points  this  situation  occurred  for  the  northern  hemispheric  analysis  on 
August  3,  1987.  (a)  Original  buddy  check;  (bj  constants  a  and  b  increased  by  50%;  (c)  keep  flags, 
as  well  as  toss  flags,  set  on  both  observations;  (d)  keep  flags  set  on  both  observations,  but  toss  flags 
set  on  only  one;  (e)  autocorrelation  used  as  flag  value  and  flag  limits  reduced  to  1.5. 
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Figure  13.  Histograms  illustrating  how  many  times  a  particular  observation  was  rejected,  and  the  number  of  observations 
in  each  of  these  categories  for  the  northern  hemispheric  analysis  on  August  3,  1987.  (a)  Original  buddy  check; 
(b)  constants  a  and  b  increased  by  50%;  (c)  keep  flags,  as  well  as  toss  flags,  set  on  both  observations;  Id)  keep  flags 
set  on  both  observations,  but  toss  flags  set  on  only  one;  (e)  autocorrelation  used  as  flag  value  and  flag  limits  reduced 
to  l.S. 
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The  first  modification  made  to  the  buddy  check  was 
simply  to  increase  the  difference  that  would  be  allowed 
between  two  temperature  anomalies  before  toss  flags 
would  be  set.  This  change  is  easily  accomplished  by 
increasing  the  values  of  the  constants  a  and  b  in 
Equation  (5).  Initially  set  at  2.0  and  1 .0,  respectively, 
the  values  of  a  and  b  were  increased  by  50%  to  3.0 
and  1.5,  resulting  in  the  tolerance  illustrated  in 
Figure  5.  The  decrease  in  the  number  of  observations 
rejected  by  the  buddy  check  is  illustrated  in  Figure  12b. 
Notice,  in  particular,  the  shift  toward  lower  numbers 
of  rejected  observations,  even  though  there  are  still  grid 
points  that  are  tossing  the  majority  of  the  selected 
observations. 

The  next  step  was  to  include  the  use  of  keep  flags 
as  well  as  toss  flags  when  the  data  were  compared. 
Thus,  when  two  anomalies  disagreed,  by  the  standards 
of  Equation  (5),  toss  flags  of  value  1 .0  were  set  on  both 
data  points.  Similarly,  when  the  two  anomalies  were 
in  agreement,  keep  flags  of  value  1 .0  were  set  on  both 
observations.  Furthermore,  any  observation  cor¬ 
roborated  by  at  least  two  other  observations  in  the 
group  could  not  be  rejected  under  any  circumstances. 
Observations  with  more  than  2.0  toss  flags  and  less 
than  2.0  keep  flags  were  removed,  following  the 
iterative  procedure  described  in  the  previous  section. 
The  results  were  fairly  dramatic,  as  illustrated  in 
Figure  12c.  With  the  addition  of  keep  flags,  very  few 
grid  points  tossed  as  many  as  five  observations,  with 
most  grid  points  only  rejecting  1  or  2  data  points.  This 
situation  appears  to  be  much  more  realistic. 
Furthermore,  the  total  number  of  observations  rejected 
has  been  reduced  from  3951  originally  to  634  in  this 
case. 

The  fourth  experiment  involved  modifying  the 
flagging  procedure  so  that  while  keep  flags  were  set  on 
both  observations,  a  toss  flag  would  be  set  on  only  one 
of  the  confliaing  data  pair.  Thus,  we  are  assuming  that 
if  two  observations  disagree,  one  of  them  is  likely  to  be 
correct  and  only  one  of  them  is  in  error.  We  further 
assume  that  the  observation  in  error  is  the  one  from  the 
source  with  traditionally  the  highest  instrument  error. 
If  the  data  pair  come  from  the  same  instrument  type, 
then  the  observation  that  is  the  least  correlated  with 
the  grid  point  is  assumed  to  be  the  erroneous  one.  This 
change  results  in  fewer  observations  rejected  in  each 
numerical  category  (Fig.  12d). 

The  final  case  makes  the  same  assumptions  as  the 
previous  experiment.  The  only  difference  is  that  the  flag 
values  are  reduced  from  a  value  of  1.0  to  the  value 
of  the  autocorrelation  between  the  pair  of  observations 
being  compared,  while  the  maximum  tolerances  on 
keep  and  toss  flags  are  reduced  from  a  total  of  2.0  to 
a  total  of  1.5.  Thus,  any  anomaly  receiving  at  least 
1.5  keep  flags  is  always  retained,  while  anomalies 
receiving  1 .5  or  more  toss  flags  and  less  than  1 .5  keep 
flags  are  removed.  This  modification  (Fig.  I2e)  actually 


seems  to  produce  worse  results  than  the  previous  ca'^e. 
While  the  basic  idea  of  using  the  autocorrelation  is  a 
sensible  one,  the  choice  of  the  limiting  value  of  1 ,5  is 
arbitrary,  and  may  not  be  the  most  suitable. 

Figure  13  shows  another  set  of  results  from  the  five 
hemispheric  buddy  check  experiments.  Since  the  data 
search  radii  generally  encompass  several  grid  intervals, 
each  observation  is  included  in  the  search  area  for  more 
than  one  grid  point,  and  is  thus  interrogated  by  the 
buddy  check  numerous  times.  If  an  observation  is  in 
error,  then  we  would  expect  it  to  be  tossed  by  nearly 
every  grid  point  that  selects  it.  Figure  13a  illustrates 
the  number  of  data  anomalies  that  are  rejected  in  the 

original  buddy  check  by  1,  2,  3 . 50  grid  points. 

Notice  the  large  number  of  observations  that  are 
rejected  only  once.  This  rate  is  a  strong  indicator  that 
the  buddy  check  is  not  performing  as  desired. 

The  modified  buddy  check  algorithms  used  in  cases 
2-4  result  in  both  a  reduction  of  the  total  number  of 
observations  rejected  (Table  2)  and  of  the  number 
of  observations  rejected  only  once  or  tw  ice  (Fig.  13b-d). 
The  improvement  is  especially  noticeable  between 
experiment  2  and  3,  due  to  the  addition  of  keep  flags 
in  the  buddy  check  process.  Again,  case  5  results 
(Fig.  13e)  are  not  as  favorable  as  the  preceding 
experiment. 

In  addition  to  summarizing  the  results  at  all  grid 
points,  each  experiment  also  tracked  the  performance 
of  the  buddy  check  at  specified  diagnostic  grid  points. 
Each  of  the  diagnostic  points  selected  15  observations, 
in  the  form  of  anomalies  or  residuals,  for  input  to  their 
respective  analyses.  The  number  of  these  residuals 
rejected  at  each  diagnostic  point  for  each  of  the  5  cases 
is  shown  in  Table  3.  The  largest  gains  are  made  between 
case  2  and  case  3,  due  to  the  addition  of  keep  flags. 

Special  attention  was  paid  to  which  panicular  residu¬ 
als  were  rejected  at  each  point.  For  example,  consider 
the  first  diagnostic  point,  located  in  the  equatorial 
Pacific  at  1.0°N,  151. 0°W.  The  selected  temperature 
residuals  are  plotted  in  Figure  14a.  None  of  the  values 
appear  particularly  out  of  place,  but  the  original  buddy 
check  rejected  five  of  these  data  points  (Table  4). 
Perhaps  the  most  anomalous  of  the  group  is  the  1 .7°C 
residual  at2.1°N,  148. 6° W.  But  the  1 .7°C  residual  is 
computed  from  an  MCSST  superob,  while  the  nearby 
2.2°  and  2.9°C  residuals  are  from  XBTs.  Since  the  data 
are  from  different  sources,  we  would  not  necessarily 
expect  extremely  close  agreement.  If  all  these  residuals 
are  allowed  to  remain  in  the  analysis,  as  they  are  in 
cases  3-5,  then  the  optimum  interpolation  scheme  will 
weight  the  different  data  types  appropriately.  Notice 
in  Table  4  that  the  analyzed  anomaly  changes  only 
slightly  from  case  to  case,  regardless  of  which  data  are 
rejected. 

The  diagnostic  point  located  at  45. 9° N,  61.6°W, 
however,  presents  a  more  complex  situation.  This  grid 
point  is  located  in  a  dynamically  active  region,  which 
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Table  5.  Quality  control  of  residuals  at  45.9° N,  61. 6° W. 


LAT 

(°N) 

LON 

(°W) 

RESID 

rc) 

DATA 

TYPE 

CASE  1 

CASE  2 

REJECTED 
CASE  3 

CASE  4 

CASE  5 

45.87 

61.57 

2.65 

MCSST 

• 

• 

45.10 

60.70 

6.89 

SHIP 

44  90 

61.00 

1.08 

SHIP 

46.60 

60.00 

4.76 

SHIP 

• 

44  60 

61.40 

1.41 

SHIP 

44.50 

61  30 

-1.72 

SHIP 

- 

45.40 

59.70 

1.30 

SHIP 

44.50 

60.80 

0.22 

SHIP 

* 

- 

46.50 

59.50 

5.26 

SHIP 

■ 

44.30 

60.60 

2.95 

SHIP 

46.70 

59.30 

2.05 

SHIP 

45.30 

58.70 

1.50 

SHIP 

43.90 

62.60 

2.23 

SHIP 

• 

43.80 

60.70 

-0.48 

SHIP 

- 

• 

47.90 

63.00 

6.09 

SHIP 

• 

ANALYZED 

RESIDUAL 

CORRECTION 

(°C) 

0.30 

0.36 

1.15 

1.35 

0.94 

results  in  a  widely  disparate  group  of  observed  anom¬ 
alies  (Fig.  14b).  Surveying  this  set  of  data,  not  much 
agreement  appears  between  any  of  the  residuals.  The 
approach  taken  by  the  original  buddy  check  is  just  to 
throw  the  majority  of  the  data  away  (Table  5). 
However,  the  analysis  should  be  able  to  smooth  this 
information  intelligently,  weighting  the  observations 


by  their  correlation  with  the  analysis  point  and 
according  to  their  respective  instrument  errors.  Table  5 
displays  the  outcome  of  the  five  buddy  check  cases. 
Note  that  case  3  removes  the  apparently  erroneous 
6.9°C  residual,  while  analyzing  one  of  the  largest  cor¬ 
rections  at  the  grid  point.  Considering  the  input  data, 
this  case  appears  to  be  the  most  suitable  of  the  five. 
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Figure  15.  fa)  Analyzed  anomalies  for  August  3,  1987,  analysis  using  original 
buddy  check.  Contours  are  every  0.5  "C.  (b)  A  nalyzed  anomalies  for  same  analysis, 
using  buddy  check  where  both  keep  and  toss  flags  are  set  on  both  observations. 
(c)  Difference  between  the  analyses  produced  in  fa)  and  fb). 


Because  of  these  results  and  other  considerations,  the 
buddy  check  implemented  in  OTIS  1.0  is  the  buddy 
check  used  in  experiment  3.  Since  the  hemispheric 
OTIS  1 .0  creates  superobs  from  the  MCSST  data  and 
does  not  distinguish  between  ship  and  buoy  data  (as 
these  tests  do),  we  were  concerned  that  the  (lagging 
hierarchy  would  not  work  especially  well,  and  that  the 
relatively  few  MCSST  superobs  would  reject  too  many 
of  the  ship  and  buoy  reports,  which  are  assigned  larger 
errors. 

The  impact  of  the  quality  control  changes  on  the 
hemispheric  SST  analysis  are  revealed  in  Figure  15, 
which  shows  the  analyzed  SST  anomalies  from  both 
the  original  buddy  check  case  (Fig.  15a)  and  the  buddy 
check  later  implemented  in  OTIS  1.0  (Fig.  15b).  The 
difference  between  the  two  analyzed  fields  is  shown  in 
Figure  15c.  Notice  that  the  largest  differences  are 
in  the  regions  where  the  original  buddy  check  rejected 
a  large  percentage  of  the  data  (Fig.  11),  and  that  some 
temperature  differences  are  as  large  as  2°C. 

The  same  five  experiments  were  repeated  for 
a  regional  Gulf  Stream  analysis  using  data  from 
March  30,  1988.  With  2  days  of  surface  data  and 
without  creating  MCSST  superobs,  there  were  9  XBTs, 
306  ship/buoy  observations,  and  12,443  MCSSTs 
within  the  grid  area.  The  buddy  check  results  are  again 
represented  by  histograms,  as  shown  in  Figures  16 
and  17.  The  results  from  the  Gulf  Stream  OTIS  buddy 
check  were  similar  to  the  hemispheric  case,  with  the 
largest  improvement  stemming  from  the  addition  of 
keep  flags.  The  total  number  of  observations  rejected 
in  each  case  is  given  in  Table  2.  Note  that  for  the 
regional  application,  case  5  results  show  an 
improvement  over  case  4.  This  difference  between  the 
hemispheric  and  regional  results  is  likely  due  to  the  fact 
that  the  MCSSTs  are  superobs  created  in  the  former, 
but  not  in  the  latter.  Thus,  for  regional  analyses,  the 
cuddy  check  algorithm  used  in  case  5  appears  to  be 
the  best  choice. 

This  conclusion  is  further  substantiated  by  the 
changes  in  the  Gulf  Stream  SST  analyses  made  from 
the  March  30,  1988  data.  Figure  18a  is  a  plot  of  the 
analysis  made  with  the  original  buddy  check  in  place; 
Figure  18b  is  the  analysis  produced  in  the  fifth 
experiment.  The  latter  case  not  only  retains  more  of 
the  observations,  but  it  also  results  in  a  more  realistic 
analysis  of  the  south  wall  of  the  Gulf  Stream. 
Furthermore,  the  analysis  in  the  Sargasso  Sea  is 
smoother,  again  reflecting  the  more  consistent  data 
handling  algorithm. 

VI.  Conclusions 

During  the  course  of  NORDA’s  work  integrating 
MCSSTs  into  the  various  versions  of  OTIS,  it  was 
observed  that  the  automated  quality  control  procedures 


were  discarding  an  excessively  large  number  of 
observations.  The  gross-error  check,  which  determines 
the  allowed  deviation  an  observation  can  have  from 
climatology,  was  too  restrictive  and  rejected  all 
anomalies  larger  than  5'C.  This  criterion  almost 
guarantees  that  the  analyzed  fields  will  look  very  much 
like  climatology.  Based  on  several  case  studies,  the 
gross-error  checks  have  been  relaxed  to  1  C  in 
OTIS  1.0  and  lO^C  in  the  regional  SST-OTIS. 

The  different  values  for  hemispheric  versus  regional 
analyses  reflect  the  fact  that  the  acceptable  anomaly 
must  be  a  function  of  the  scales  to  be  analyzed. 
Furthermore,  in  the  ideal  situation,  the  gross-error 
check  should  also  be  a  function  of  the  particular 
location  of  the  observation.  This  v  ariation  would  allow 
less  restrictive  criteria  to  be  used  in  areas  of  extremely 
cold  upwelling  and  dynamically  active  regions  of  the 
oceans,  without  permitting  bad  data  to  pass  through 
in  areas  where  little  deviation  from  climatology 
would  be  expected.  FNOC  is  pursuing  this  idea  and 
should  implement  it  in  the  future. 

Relaxing  the  gross-error  check  makes  it  even  more 
important  to  apply  the  buddy  check  properly  if 
erroneous  observations  are  to  be  identified  and 
removed.  Experiments  with  both  regional  and  hemi¬ 
spheric  analyses  clearly  demonstrated  that  the  original 
buddy  check  design  was  far  too  intolerant.  Altering 
the  values  of  some  of  the  empirical  constants  and 
adding  the  use  of  keep  flags  for  corroborating 
observations  greatly  reduced  the  incidence  of  data 
rejection.  Other,  more  subtle,  refinements  in  the  buddy 
check  were  not  implemented  in  OTIS  1 .0,  but  probably 
have  merit  for  regional  analyses,  especially  if  the 
MCSST  data  are  not  superobed. 

One  further  problem  with  the  buddy  check  remains. 
The  buddy  check  implemented  in  OTIS  1.0  and 
described  by  Bergman  (1979)  is  a  point-by-point 
procedure;  that  is,  only  the  data  selected  for  the 
analysis  at  each  point  are  actually  screened.  Such  a 
procedure  has  the  advantage  of  being  fast,  since  it 
checks  only  the  data  input  to  the  analysis  and  therefore 
has  to  search  the  data  only  once  per  grid  point. 
However,  it  also  has  the  undesirable  capability  of 
excluding  an  observation  at  one  point  while  accepting 
and  using  it  at  the  next.  Because  this  is  a  potential 
source  of  noise  in  the  analysis,  NMC  later  chose  to 
perform  all  data  screening  prior  to  beginning  the  actual 
analysis,  and  to  design  the  system  in  such  a  way  that 
each  observation  was  guaranteed  to  be  included  in 
at  least  one  group  (Kistler  and  Parrish,  1982). 

During  discussions  with  FNOC,  NORDA  suggested 
that  all  quality  control  of  the  data  in  OTIS  be  done 
prior  to  the  actual  analysis.  This  way,  the  rejected 
observations  are  permanently  removed  from  the  data 
set  and  are  not  included  in  the  analysis  at  any  point. 
However,  because  of  the  major  software  changes 
required  to  accomplish  such  a  task,  no  action  has  been 
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Figure  16.  Histograms  illustrating  how  many  of  the  15  selected  observations  were  rejected  by  the  buddy 
check,  and  at  how  many  grid  points  this  situation  occurred  for  the  regional  Gulf  Stream  analysis  on 
March  30,  1988.  (a)  Original  buddy  check;  (b)  constants  a  and  b  increased  by  50%;  (c)  keep  flags,  as  well 
as  toss  flags,  set  on  both  observations;  (d)  keep  flags  set  on  both  observations,  but  toss  flags  set  on  only 
one;  (e)  autocorrelation  used  as  flag  value  and  flag  limits  reduced  to  1.5. 
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Figure  17.  Histograms  illustrating  how  many  times  a  particular  observation  was  rejected,  and  the  number  of 
observations  in  each  of  these  categories  for  the  regional  Gulf  Stream  analysis  on  March  30,  1988.  (a)  Original  buddy 
check;  (b)  constants  a  and  b  increased  by  50%;  <cj  keep  flags,  as  well  as  toss  flags,  set  on  both  observations; 
(d)  keep  flags  set  on  both  observations,  but  toss  flags  set  on  only  one;  (e)  autocorrelation  used  as  flag  value  and 
flag  limits  reduced  to  1.5. 
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taken  along  these  lines  in  OTIS  l.O.  Also,  at  the  time, 
the  point-by-point  buddy  check  did  serve  a  useful 
purpose.  At  grid  points  near  the  boundaries  of 
mesoscale  features,  where  strong  gradients  e.xist,  the 
buddy  check  could  effectively  decorrelate  data  across 
those  boundaries  by  rejecting  the  large  anomalies  that 
would  be  present  in  the  other  water  mass. 

Several  later  changes  make  this  idea  much  less 
effective.  First,  the  anomalies  on  the  other  side  of  the 
mesoscale  boundaries  were  large  because  at  the  time, 
all  anomalies  were  formed  relative  to  the  analysis  grid 
point.  That  is,  once  the  15  observations  were  selected, 
the  first  guess  valid  at  the  grid  point  was  subtracted 
from  each  temperature  observation.  This  oversight 
results  in  an  observation  with  a  different  anomaly  value 
for  every  analysis  point  using  that  observation.  Such 
a  definition  directly  contradicts  the  theory  of 
optimum  interpolation,  which  requires  that  the  first 
guess  be  interpolated  from  the  gridded  field  to  the 
location  of  each  observation  and  subtracted  from 
the  observed  value  to  form  the  anomaly.  This  error 
has  now  been  corrected,  making  the  buddy  check  less 
effective  for  decorrelating  separate  water  masses. 

Furthermore,  for  regional  analyses  where  mesoscale 
features  play  an  important  role,  a  separate  technique 
has  been  designed  to  decorrelate  data  across  these  front 
and  eddy  boundaries  (STX,  1987).  During  the  data 
selection  process,  only  observations  that  are  in  the  same 
water  mass  as  the  analysis  grid  point  can  be  considered. 
Therefore,  the  anomalies  that  are  buddy  checked 
together  at  a  point  are  always  considered  to  be  in 
the  same  water  mass.  Thus,  the  arguments  to  keep  the 
buddy  check  within  the  analysis  are  now  less  relevant. 

The  next  generation  of  regional  OTIS,  called 
OTIS  2.0,  became  operational  in  the  Gulf  Stream  area 
in  June  1989.  This  version  of  OTIS  corrects  some  of 
the  previous  problems  with  quality  control  in  OTIS  1 .0. 
In  particular,  it  does  all  the  quality  control  before 
the  analysis  begins.  It  also  uses  a  sophisticated 
technique  whereby  optimum  interpolation  is  used  to 
perform  the  horizontal  consistency  check.  In  this 
approach,  an  optimum  interpolation  analysis  is  made 
at  the  location  of  each  questionably  large  anomaly 
using  all  the  neighboring  observations,  but  not  the  data 
point  in  question.  This  analyzed  value  is  then  compared 
to  the  excluded  observation,  and  if  the  deviation  is  not 
too  large,  then  the  observation  is  allowed  to  remain 
(J.  Cummings,  Fleet  Numerical  Oceanography  Center, 
pers.  comm.,  1989).  This  method  has  been  used  by  the 
Naval  Environmental  Prediction  Research  Facility  and 
others  for  quality  control  of  meteorological  data,  and 
has  proven  to  be  very  successful.  It  is,  however,  more 
demanding  of  computer  resources  and  thus  may  not 
be  practical  for  all  applications. 


VII.  Recommendations 

In  summary,  the  changes  made  to  the  quality  control 
and  data  selection  procedures  in  OTIS  1 .0  resulted  in 
an  analysis  that  was  faster,  more  accurate,  and  verified 
better  against  independent  data  sources  (R.  M.  Clancy, 
Fleet  Numerical  Oceanography  Center,  pers.  comm.. 
1989).  These  experiments  have  further  demonstrated 
that  quality  control  of  the  available  data  is  extremely 
important.  Additionally,  more  sophisticated, 
automated  procedures  should  be  developed  to 
intelligently  handle  the  vast  amounts  of  data  that  must 
be  checked.  Since  the  analysis  is  a  reflection  of  the  input 
data,  it  is  crucial  that  erroneous  observations  are  not 
allowed  to  have  an  undue  influence  on  the  final 
product. 


VIII.  References 

Barker,  E.  H.,  J.  Goerss,  and  N.  Baker  (1988). 
Navy’s  operational  multivariate  optimum  interpolation 
method.  Presented  at  the  Eighth  Conference  on 
Numerical  Weather  Prediction,  February  22-26,  1988, 
Baltimore,  MD. 

Bennett,  T.,  M.  Carnes,  P.  Phoebus,  and 
L.  Reidlinger  (1989).  Feature  Modeling:  Incorporation 
of  a  Front  and  Eddy  Map  into  Optimum  Interpolation- 
based  Thermal  Analyses.  Naval  Ocean  Research  and 
Development  Activity,  Stennis  Space  Center,  MS 
39529,  NORDA  Report  242. 

Bergman,  K.  (1979).  Multivariate  analysis  of 
temperature  and  winds  using  optimum  interpolation. 
Monthly  Weather  Review  107:1423-1444. 

Bernstein,  R.,  and  W.  White  (1974).  Time  and  length 
scales  of  baroclinic  eddies  in  the  central  North  Pacific 
Ocean.  Journal  of  Physical  Oceanography  4:613-624. 

Bretherton,  F.  P.,  R.  Davis,  and  C.  Fandry  (1976). 
A  technique  for  objective  analysis  and  design  of 
oceanographic  experiments  applied  to  MODE-73. 
Deep-Sea  Research  23:559-582. 

Carter,  E.  F.  and  A.  Robinson  (1981).  Analysis 
models  for  the  estimation  of  oceanic  fields.  Journal 
of  Atmospheric  and  Oceanic  Technology  4:49-74. 

Clancy,  R.  M.  and  K.  Poliak  (1983).  A  real-time 
synoptic  ocean  thermal  analysis/ forecast  system. 
Progress  in  Oceanography  12:383-424. 

Clancy,  R.  M.,  P.  Phoebus,  and  K.  Poliak  (1989). 
Technical  Description  of  the  Optimum  Thermal 
Interpolation  System  (OTIS)  Version  1:  A  Model  for 
Oceanographic  Data  Assimilation.  Naval  Ocean 
Research  and  Development  Activity,  Stennis  Space 
Center,  MS  39529,  NORDA  Report  240. 

Clancy,  R.  M.,  P.  Phoebus,  and  K.  Poliak  (1990). 
An  operational  global-scale  ocean  thermal  analysis 
system.  Journal  of  Atmospheric  and  Oceanic 
Technology  7(2):233-254. 


20 


Daley,  R,,  A.  Hollingsworth,  J.  Ploshay, 
K.  Miyakoda,  W.  Baker,  E.  Kalnay,  C.  Dey, 
T.  Rrishnamarti,  and  E.  Barker  (1985).  Objective 
analysis  and  assimilation  techniques  used  for  the 
production  of  FGGE  Illb  analyses.  Bulletin  of  the 
American  Meteorological  Society  77:532-538. 

Dey,  C.  H.  and  L.  Morone  (1985).  Evolution  of  the 
National  Meteorological  Center  global  data  assimila¬ 
tion  System:  January  1982-December  1983.  Monthly 
Weather  Review  113:304-318. 

DiMego,  G..  P.  Phoebus,  and  J.  McDonnell  (1985). 
■‘Data  processing  and  quality  control  for  optimum 
interpolation  analyses  at  the  National  Meteorological 
Center.”  National  .Meteorological  Center,  W,/NMC2, 
VVWB,  Room  204,  Washington,  DC  20233,  NMC 
Office  Note  306. 

DiMego,  G.  J.  (1988).  The  National  Meteorological 
Center  regional  analysis  system.  Monthly  Weather 
Review  116:977-1000. 

Freeland,  J.  H.  and  W.  Gould  (1976).  Objective 
analysis  of  mesoscale  ocean  circulation  features.  Deep- 
Sea  Research  23:915-923. 

Gandin,  L.  S.  (1963).  Objective  analysis  of 
meteorological  fields.  Gidrometeorologichoskoe 
Isdatel’stvo,  Leningrad,  translated  from  Russian,  Israel 
Program  for  Scientific  Translations,  Jerusalem,  1964, 
242  pp. 

Hollingsworth,  A.,  A.  Lorenc,  M.  Tracton,  K.  Arpe, 
G.  Cats,  S.  Uppala,  and  P.  Kallberg  (1985).  The 
response  of  numerical  weather  prediction  systems  to 
FGGE  level  lib  data.  Part  I:  Analyses.  Quarterly 
Journal  of  the  Royal  Meteorological  Society  1 1 1 : 1-66. 

Kistler,  R.  E.  and  D.  Parrish  (1982).  Evolution  of 
the  NMC  data  assimilation  system:  September  1978- 
January  1982.  Monthly  Weather  Review  110:1335-1346. 

Lorenc,  A.  C.  (1981).  A  global  three-dimensional 
multivariate  statistical  interpolation  scheme.  Monthly 
Weather  Review  109:701-721. 

Lorenc,  A.  C.  (1986).  Analysis  methods  for 
numerical  weather  prediction.  Quarterly  Journal  of  the 
Royal  Meteorological  Society  112:1177-1194. 


McPherson,  R.  D.,  R.  Bergman,  R.  Kistler, 
G.  Rasch,  and  D.  Gordon  (1979).  The  .N.MC 
operational  global  data  assimilation  system.  Monthly 
Weather  Review  107:1445-1461. 

.McWilliams,  J.  C.,  W.  Owens,  and  L.  Hua  (1986). 
-An  objective  analysis  of  the  POLYMODE  local 
dynamics  experiment.  Part  1:  General  formalism  and 
statistical  model  selection.  Journal  of  Physical 
Oceanography  16:483-504. 

Phoebus,  P.  .A.  (1988).  Improvements  to  the  Data 
Selection  Algorithms  in  the  Optimum  Thermal 
Interpolation  System  (OTIS).  Naval  Ocean  Research 
and  Development  Activity,  Stennis  Space  Center, 
MS  39529,  NORDA  Report  239. 

Phoebus,  P.  .A.  (1983).  “Recent  changes  in  the 
quality  control  of  observational  data  for  the  NMC 
upper  air  analysis.”  National  .Meteorological  Center, 
W/NMC2,  WWB,  Room  204,  Washington,  DC  20233, 
NMC  Medium-Range  Modeling  Branch  Paper  No.  1 . 

Robinson,  A.  R.  and  W.  Leslie  (1985).  Estimation 
and  prediction  of  oceanic  eddy  fields.  Progress  in 
Oceanography  14:485-510. 

Roemmich,  D.  (1983).  Optimal  estimation  of 
hydrographic  station  data  and  derived  fields.  Journal 
of  Physical  Oceanography  13:1544-1549. 

Rutherford,  1.  D.  (1976).  An  Operational  three- 
dimensional  multivariate  statistical  objective  analysis 
scheme.  Proceedings,  Study  Group  Conference  on 
Four-dimensional  Data  Assimilation,  Paris, 
17-21  November  1975,  GARP  Report  No.  11. 

STX  (1987).  Upgrades  to  OTIS.  ST  Systems 
Corporation  (STX),  1900  Garden  Road,  Suite  130, 
Monterey,  CA  93940,  Technical  Report  STI  6617, 

80  pp. 

Thiebaux,  H.  J.  (1980).  Anticipated  changes  in 
analysis  accuracy  with  removal  of  Ocean  Weather 
Ship  P.  Atmosphere-Ocean  18:261-285. 

White,  W.  B.  (1977).  Secular  variability  in  the 
baroclinic  structure  of  the  interior  North  Pacific  from 
1950-1970.  Journal  of  Marine  Research  4:587-607. 


21 


Distribution  List 


Applied  Physics  Laboratory 
Johns  Hopkins  University 
John  Hopkins  Road 
Laurel  MD  20707 
Attn:  Dr,  J  Apel 

Applied  Physics  Laboratory 
University  of  Washington 
1013  NE  40th  St 
Seattle  WA  98105 

Applied  Research  Laboratory 
Pennsylvania  State  University 
P,0.  Box  30 
State  College  PA  168OI 

Applied  Research  Laboratory 
University  of  Texas  at  Austin 
P,0  Box  8029 
Austin  TX  78713-8029 

Assistant  Secretary  of  the  Navy 
Research,  Engineering  &  Systems 
Washington  DC  20350-2000 

Cal  Space 
5360  Bothe  Ave. 

San  Diego  CA  92122 
Attn:  Dr.  R.  Bernstein 

Chief  of  Naval  Operations 
Washington  DC  20350-2000 
Attn:  OP-71 
OP-987 

Chief  of  Naval  Operations 
Oceanographer  of  the  Navy 
Washington  DC  20392-1800 
Attn:  OP-096 
OP-96B 

CIMAS 

4600  Rickenbacker  Causeway 
Virginia  Key  FL  33149 
Attn:  Director 

David  W.  Taylor  Naval  Research  Cntr 
Bethesda  MD  20084-5000 
Attn:  Commander 

Defense  Mapping  Agency 
Systems  Center 
12100  Sunset  Hill  Rd.  #200 
Res'on  VA  22090-3207 
Attn:  Director 

Code  SOWN 

Director  of  Navy  Laboratories 
Crystal  Plaza  #5,  Rm.  1062 
Washington  DC  20360 

Fleet  Antisub  Warfare  Tng  Ctr-Atl 

Naval  Station 

Norfolk  VA  23511-6495 

Fleet  Numerical  Oceanography  Center 
Monterey  CA  93943-5005 
Attn.  Commanding  Officer 

Code  40.  LCDR  D.  Steiner 
Code  40B,  Mr.  L.  Clarke 
Code  42,  Mr.  R.  M.  Clancy 
Code  42,  Dr.  j.  Cummings 
Code  42,  Or.  K.  Poliak 
Code  43.  Dr,  J,  Cornelius 
Code  70B,  Ms,  P.  Chavasant 

Florida  State  University 
Meteorology  Annex 
Tallahassee  FL  32306-3041 
Attn:  Dr.  J.  O'Brien 

GFDL-NOAA 
P.O.  Box  308 
Princeton  University 
Princeton  NJ  08542 
Attn:  Ms.  B.  Samuels 


Harvard  University 
Division  of  Applied  Sciences 
28  Oxford  St. 

Cambridge  MA  02138 
Attn:  Dr  A.  Robinson 

Institute  for  Naval  Oceanography 
Stennis  Space  Center  MS  39529 
Attn:  Dr.  J.  Leese 

CDR  E.  Johnson 

Martin  Marietta 
FNOC  Code  40 
Monterey  CA  93943 
Attn:  Dr.  Paul  May 

Mr.  Mark  Ignaszewski 
Mr.  B  Mendenhall 

National  Aeronautics  &  Space 
Administration 

Goddard  Space  Flight  Center 

Greenbelt  MD  20771 

Attn:  Code  912,  Dr.  T.  Busalacchi 

National  Aeronautics  &  Space 
Administration  HQ 
Washington  DC  20233 
Attn:  Or.  E.  Njoku 

National  Meteorological  Center 
World  Weather  Building 
Washington  DC  20233 
Attn;  W/NMC2.  Dr.  G.  DiMego 
W/NMC2.  Dr.  J.  Thiebaux 
W;NMC4,  Dr.  C.  Dey 
W/NMC21,  Dr.  L.  Breaker 
W/NMC21.  Mr.  B.  Gemmill 

National  Ocean  Data  Center 
1825  Connecticut  Ave.,  N'* 

Universal  Bldg.  South  R,n  40C 
Washington  DC  2C235 
Attn;  M'  3.  'Arthee 

National  Oceanic  &  Atmospheric 
Administration 

NcGS  S/PF1'  Wcrtd  Weather  Building 
Washington  DC  20233 
Attn:  Dr.  P.  S.  Deleonibus 

National  Ocean  Survey 

Ocean  Products  Div.,  WWB,  Rm.  201 

5200  Auth  Rd. 

Camp  Springs  MD  20746 
Attn:  Mr.  R.  Barazotto 
Dr.  W.  Campbell 

National  Ocean  Survey 

Ocean  Applications,  Bldg.  4 

Fleet  Numerical  Oceanography  Center 

Monterey  CA  93943-M05 

Attn;  Dr.  M.  Holl 

National  Space  Science  Data  Center 
4400  Forbes  Blvd. 

Lanham  MD  20706 
Attn:  Ms.  M.  James 

National  Weather  Service 
Wxl,  GRAMAX 
1325  East  West  Hwy. 

Silver  Spring  MD  20910 
Attn:  Dr.  R.  McPherson 

Naval  Air  Development  Center 
Warminster  PA  18974-5000 
Attn:  Commander 

Naval  Air  Systems  Command  HQ 
Washington  DC  20361-0001 
Attn:  Commander 

Naval  Civil  Engineering  Laboratory 
Port  Huerieme  CA  93043 
Attn:  Commanding  Officer 


Naval  Coastal  Systems  Center 
Panama  City  FL  32407-500C 
Attn;  Commanding  Officer 

Naval  Eastern  Oceanography  Center 
McAdie  Bldg..  U-1 17 
NAS  Norfolk  VA  23511-5399 
Attn:  Mr,  C  Weigand 

Naval  Facilities  Engineering 
Command  HQ 
200  Stovall  St. 

Alexandria  VA  22332-2300 
Attn;  Commander 

Naval  Oceanographic  Office 
Stennis  Space  Center  MS  39529 
Attn:  Commanding  Officer 

Code  OS.  Mr,  L.  Bernard 
Code  OS.  Mr  M,  Boston 
Code  OST.  Mr.  A,  Johnson 
Code  OSTM.  Dr.  C.  Horton 
Code  OSTM,  Mr.  R.  Rhodes 
Code  OST,  Mr.  J.  Rigney 

Naval  Oceanography  Command 
Stennis  Space  Center  MS  39529 
Attn:  Commander 

Naval  Oceanograohic  &  Atmospheric 
Research  Laboratory 
Stennis  Space  Center  '.'S  39529-5004 
Attn:  Code  100 
Code  105 
Code  110 
Code  115 
Code  125L  (10) 

Code  125P 
Code  200 

Code  222,  Mr.  G.  Kerr 
Code  300 

Code  321.  Mr.  J.  Hawkins 
Code  321,  Mr.  D.  May 
Code  321.  Mr.  A,  Pressman 
Code  322,  Dr.  J.  Harding 
Code  322,  Dr.  M  Carnes 
Code  322,  Dr.  T.  Bennett 
Code  323,  Dr.  G  Heburn 
Code  323,  Dr.  D  Blake 
Code  331.  Dr.  J.  Boyd 

Naval  Oceanographic  &  Atmospheric 
Research  Laboratory 
Monterey  CA  93943-5006 
Attn:  Code  400 

Code  431,  Dr.  J,  Goerss 

Naval  Oceanographic  &  Atmospheric 

Research  Laboratory 

Liaison  Office 

Crystal  Plaza  #5,  Rm.  802 

Arlington  VA  22202-5000 

Attn:  Mr.  B.  Farquhar 

Naval  Ocean  Systems  Center 
San  Diego  CA  92152-5000 
Attn:  Commander 

Naval  Research  Laboratory 
Washington  DC  20375 
Attn:  Commanding  Officer 

Naval  Sea  Systems  Command  HQ 
Washington  DC  20362-5101 
Attn:  Commander 

Naval  Postgraduate  School 
Monterey  CA  93943 
Attn;  Superintendent 

Code  63,  Dr.  R.  Renard.  Chairman 
Code  68,  Dr.  C.  A.  Collins 

Naval  Surface  Weapons  Center 
Dahlgren  VA  22448-5000 
Attn:  Commander 


Naval  Surface  Warfare  Center/ 

White  Oak 

10901  New  Hamoshire  Ave. 

Silver  Spring  MD  20904-5000 
Attn:  Commander 
Library 

Naval  Underwater  Systems  Center 
Newport  Rl  02841-5047 
Attn:  Commander 

Naval  Underwater  Systems  Center 
New  London  Laboratory 
New  London  CT  06320 
Attn:  Officer  in  Charge 

Naval  Western  Oceanography  Center 
Box  113 

Pearl  Harbor  HI  96860-5050 
Attn:  COR  P.  Kelley 

NESDIS  SRL 
Washington  DC  20233 
Attn:  (ERA1).  Mr.  P.  McClain 
(E/SP13),  Dr.  B,  Pichel 

NOAA-AOML 

4301  Rickenbacker  Causeway 
Virginia  Key  FL  33149 
Attn:  Dr,  G.  Maul 

NOAA  Data  Buoy  Center 
Stennis  Space  Center  MS  39529 
Attn:  Dr.  G.  Hamilton 

NOAA  Pacific  Marine  Env.  Res.  Lab. 
7600  Sand  Point  Way  NE 
Seattle  WA  98115-0070 
Attn:  Dr.  M.  McPhaden 


Office  of  Naval  Research 
800  N.  Quincy  St. 

Arlington  VA  22217-5000 
Attn:  Code  10 

Code  10D/10P.  Dr.  E  Silva 
Code  112,  Dr.  E.  Hartwig 
Code  12 

Code  120M.  Mr.  R,  Peloquin 

Office  of  Naval  Research 
ONR  Branch  Office 
Box  39 

FPO  New  York  NY  09510-0700 
Attn:  Commanding  Officer 

Office  of  Naval  Technology 
800  N.  Quincy  St. 

Arlington  VA  22217-5000 
Attn.  Code  234.  Dr.  C  Votaw 
Code  228.  Dr  M  Briscoe 

SAIC 

Mail  Stop  34,  10260  Campus  Pt  Dr 
San  Diego  CA  92121 
Attn:  Dr  G.  Innis 

SAIC 

4900  Water's  Edge  Dr..  Suite  510 
Raleigh  NC  27606 
Attn:  Dr.  V.  VYaddel 

Scripps  Institution  of  Oceanography 
La  Jolla  CA  92093 
Attn:  Or.  S.  Pazan 
Dr.  W.  White 

Scripps  Institution  of  Oceanography 
University  of  California 
P.O.  Box  6049 
San  Diego  CA  92106 


Space  and  Naval  Warfare 
Systems  Command 
251 1  Jeff  Davis  Hwy. 

Washington  DC‘20363-5100 
Attn:  Commander 

Code  PMW  141.  LCDR  B  Cook 
Code  PMW  141. 

CDR  G.  Trumbower 

University  of  Colorado 
Dept,  of  Aerospace  Eng.  Sci 
Campus  Box  429 
Boulder  CO  80309-0429 
Attn:  Dr.  G.  Born 

University  of  Miami 
Center  for  Marine  Studies 
4600  Rickenbacker  Causeway 
Miami  FL  33149-1098 
Attn:  Dn  O.  Brown 

Univer'-ity  of  Oklahoma 
Depart  nent  of  Meteorology 
200  Feigar  St. 

Norman  OK  73019 

Attn:  Dr.  C.  Duchon.  Chairman 

U.S.  Naval  Academy 
Department  of  Oceanography 
Annapolis  MD  21402-5026 
Attn:  Chairman 

Dr.  A.  Strong 

U.S.  Naval  Observatory 

34th  St.  &  Massachusetts  Ave  .  NW 

Bldg.  1 

Washington  DC  20392-1800 
Attn:  Mr  D.  Montgomery 

Woods  Hole  Oceanographic  Institution 
P  O.  Box  32 
Woods  Hole  MA  02543 
Attn:  Dr.  C.  Dorman.  Director 
Dr.  J.  Price 


REPORT  DOCUMENTATION  PAGE 


Form  Aooroweo 
0MB  No  0704-0188 


=  c  •eco'^  "Q  ‘c'  •*'^5  :o"ec’  cr  r^cfT^at  o''  s  estirr'atea  '.o  average  ’  '^co^  ;:e^  'esoc^'se  f^ciuCi'^g  •'^e  •  ‘a^  'e.  e*  "g  crs  sea''"  s*  '- ;  :i' a  ; 

;a'''e'  ''g  d/^Q  "’e  ra^a  ''eedec  a^c  cor^cie^''g  af'd  'eview>ng  ♦♦'e  :ciiec*cn  2*  Se'^d  tc^^'^ents  ’ega'c  ''g  "'■s  “u'Ce'*  es*  ~a'e  3''.  -•-c’  i-j 

•^'S  :;:iec*  o'^  of  .n'or'^at^onv  -^c’bGi''g  Si-ggest'C'^s  ‘or  'ecuc  ''g  Curaer*  ‘c  Wasr'.rgtor  Heacouar'e'?  Se^'.-ces  D-'ecTorate  ‘or  '''‘or^-at  o'"  Cce'at  c's  a''o  ^ecc^s  T'':  .•? 
3avs  "^  gr-vav  Suite  ’2C4  -A22202-43C2  ana  *0  f'e  Of*  ce  :•*  Varage'^e'^r  a'' :  Budge?  ®ace'"ArcrK  oeo-ct^c''  i^'o.ect  C’Oa-O'SB'  /.as" 2C:‘‘;j 


1.  Agency  Use  Only  (Leave  t^fanKi  2.  Report  Date. 

Marcn  1990 


4.  Title  and  Subtitle. 

Quality  Control  Algorithms  for  Ocean  Temperature  Data 


3.  Report  Type  and  Oates  Covered. 

Final 


5.  Funding  Numbers. 

P-21'ar-  E  e'^e"'  \c  63704N 


7.  Performing  Organization  Name(s)  and  Address(es). 

Ocean  Science  Directorate 

Naval  Ocean  Research  and  Development  Activity 

Stennis  Space  Center,  Mississippi  39529-5004 


Access .J"  Sc 


DN394457 


8.  Performing  Organization 
Report  Number. 

NORDA  Report  243 


9.  Sponsoring/Monitoring  Agency  Namefs)  and  Address(as). 


10.  Sponsoring/Monitoring  Agency 
Report  Number. 


Space  and  Naval  Warfare  Systems  Command 
Washington,  DC 


12a.  Olstrlbutlon/Avallabillty  Statement. 


12b.  Distribution  Code. 


Approved  for  public  release:  distribution  is  unlimited.  Naval  Ocean  Research  and 
Development  Activity,  Stennis  Space  Center,  Mississippi  39529-5004. 


13.  Abstract  (Maximum  200  words). 

The  Fleet  Numerical  Oceanography  Center  (FNOC)  provides  daily  analyses  of  the  three-dimensional  ocean  thermal  structure  both 
to  the  Fleet  and  to  regional  oceanography  centers  around  the  world.  These  analyses  are  performed  on  both  hemispheric  and  regional 
scale  grids,  with  resolutions  as  fine  as  20  km  m  some  areas.  The  Remote  Sensing  Branch  of  the  Naval  Ocean  Research  and  Development 
Activity  (NOROA)  has  been  involved  in  assessing  the  impact  of  multichannel  sea  surface  temperatures  (MCSSTsi  on  these  ocean  thermal 
analyses.  Specifically,  NORDA  has  worked  closely  with  FNOC  in  developing  the  Optimum  Thermal  Interpolation  System  (OTIS).  NORDA  s 
primary  interest  was  to  assure  that  the  MCSSTs  were  property  utilized  to  detect  and  analyze  mesoscale  ocean  fronts  and  eddies,  with 
particular  attention  paid  to  how  the  MCSSTs  were  assimilated  with  other  types  of  data.  Through  this  loint  effort,  FNOC  has  successfully 
implemented  OTIS  as  the  operational  ocean  thermal  analysis  system  for  the  global  analysis  and  the  Gulf  Stream  regional  analysis 

In  addition  to  processing  and  assimilating  data  from  various  sources.  OTIS  includes  algorithms  to  automatically  make  decisions 
about  the  quality  of  the  observations  and  to  ignore  data  that  are  apparently  erroneous.  There  are  two  basic  .methods  of  quality  controlling 
data  in  OTIS.  The  first  is  the  gross-error  check,  where  observations  are  compared  to  the  climatological  first-guess  field  to  assure  that 
the  data  fall  within  reasonable  ranges  of  the  expected  values.  Then,  groups  of  observations  are  subjected  to  a  check  for  horizontal 
consistency,  often  called  a  "buddy  check."  Thus,  if  a  particular  observation  cannot  be  corroborated  by  other  nearby  data,  it  is  generally 
excluded  from  the  analysis.  This  report  describes  the  details  of  the  automated  quality  control  procedures  in  C7TIS.  and  provides  an  account 
of  the  fine  tuning  that  is  necessary  to  optimize  these  techniques.  The  end  result  is  a  system  that  eliminates  most  of  the  bad  data  while 
retaining  most  of  the  valid  observations,  thus  contributing  to  an  improved  ocean  thermal  analysis  product. 


14.  Sub|ect  Terms. 

MCSST.  optimum  interpolation,  OTIS,  quality  control,  data  analysis 


15.  Number  of  Pages. 
24 


16.  Price  Coda. 


17.  Security  Claesificatton 
of  Rap^. 

Unclassified 


18.  Security  Classification 
of  This  Page. 

Unclassified 


19.  Security  Classification 
of  Abstract. 

Unclassified 


20.  Limitation  of  Abstract. 


MSN  rS40-Oi-2SO-5SOO 


Slanoaro  298  :  -3iy. 

D»  s»i3 


